Image processing apparatus and image processing method

ABSTRACT

An image processing apparatus includes a region detection unit configured to detect from an image a region which is sandwiched between a pair of opposite lines and in which image formation is performed at a density lower than a predetermined density, a rendering unit configured to render a border of an inner portion inside the region sandwiched between the pair of opposite lines with a line having a density higher than the predetermined density, and an outputting unit configured to output an image in which the inner portion inside the region sandwiched between the pair of opposite lines is bordered by the border rendered by the rendering unit.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing apparatus and animage processing method for forming images.

2. Description of the Related Art

In printers, faxes, and copiers employing an electrophotographic method,it is difficult to reproduce a highlighted portion of an image due todata loss caused by quantization of image data or the lack of tonerattraction force that is a problem specific to such anelectrophotographic method.

A portion having a pixel density that is 15 percent or less of the pixeldensity of a solid black portion will be hereinafter referred to as themost highlighted portion.

It is possible to solve the lack of toner attraction force by changing,for example, a transfer current process in an electrophotographicapparatus.

However, a so-called fog phenomenon in which toner is supplied to aportion requiring no toner on a sheet sometimes occurs.

Accordingly, an image processing method of forming an image without lossof data at the time of quantization of original image data and an imageprocessing method of forming an image with sufficiently large tonerattraction force between toner particles or between each toner particleand a photosensitive drum without dispersion of toner have beenproposed.

Japanese Patent Laid-Open No. 5-95474 discloses a technique forbinarizing image data while maintaining the density levels of pixelsnear a pixel of interest on an image at the time of quantization of theimage data.

Using this technique, toner can be intensively supplied while minimizingloss of original image data of a highlighted portion.

Thus, in order to improve the roughness of an image due to binarizationof image data, a method of converting image data into multi-valued imagedata at the time of quantization of the image data has come into generaluse.

However, even if the above-described method is used, the mosthighlighted portion of an original image is reproduced with a smallamount of toner.

Accordingly, the attraction force between toner particles or betweeneach toner particle and a photosensitive drum may not becomesufficiently large, and a toner image may not be developed on aphotosensitive drum.

Furthermore, a toner image on a photosensitive drum may not betransferred to a sheet, and the most highlighted portion of an image maynot be reproduced.

Still furthermore, the efficiency of transferring toner to a sheet maybe changed in accordance with a print environment or the endurance of aprinter, and the most highlighted portion of an image may not bereproduced.

SUMMARY OF THE INVENTION

According to one aspect of the invention, there is provided an imageprocessing apparatus including: a region detection unit configured todetect from an image a region which is sandwiched between a pair ofopposite lines and in which image formation is performed at a densitylower than a predetermined density; a rendering unit configured torender a border of an inner portion inside the region sandwiched betweenthe pair of opposite lines with a line having a density higher than thepredetermined density; and an outputting unit configured to output animage in which the inner portion inside the region sandwiched betweenthe pair of opposite lines is bordered by the border rendered by therendering unit.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart describing a first embodiment.

FIG. 2 is a block diagram illustrating the entire configuration of animage processing system according to an embodiment.

FIGS. 3A, 3B, and 3C illustrate examples of a region to be convertedaccording to the first embodiment.

FIG. 4 illustrates an example of image processing B according to thefirst embodiment.

FIG. 5 illustrates an example of image processing A according to thefirst embodiment.

FIG. 6 is a flowchart describing an example of a process of detectingthe region to be converted according to the first embodiment.

FIG. 7 is a flowchart describing an example of the image processing Aaccording to the first embodiment.

FIG. 8 is a flowchart describing an example of a second embodiment.

FIG. 9 is a flowchart describing an example of a fifth embodiment.

FIG. 10 is a cross-sectional view of an engine unit included in an imageprocessing system according to the first embodiment.

FIG. 11 illustrates a driver UI screen according to fourth and seventhembodiments.

FIG. 12 illustrates a driver UI screen according to a sixth embodiment.

FIG. 13 illustrates a preview screen according to an eighth embodiment.

FIG. 14 illustrates a preview screen according to a ninth embodiment.

DESCRIPTION OF THE EMBODIMENTS

In first to ninth embodiments, in order to appropriately reproduce themost highlighted portion, image processing applying the “watercoloreffect”, which is a kind of illusion effect, is performed upon an imagehaving a density equal to or lower than a certain density.

The “watercolor effect” was proposed by Pinna, and Brelstaff andSpillmann.

Human beings have a visual characteristic called “color complementation”in which they see something that is not really there by complementing acolor.

The “watercolor effect” is an effect using such a visual characteristic.

The “watercolor effect” is an illusion caused by relatively comparing aborder with a line inside the border.

If an inner portion inside the border is bordered with a color differentfrom the color of the border, the inner portion is perceived as beinglightly painted with the color used for bordering.

The first embodiment of the present invention will be described withreference to FIGS. 1, 2, and 10.

Configuration of Image Processing System

FIG. 2 illustrates an example of the entire configuration of an imageprocessing system according to the first embodiment of the presentinvention. The image processing system illustrated in FIG. 2 includes acontroller (1002 to 1027) for controlling the image processing system,an engine unit 1028 (to be described in detail below with reference toFIG. 10), a panel unit 1029, and a scanner unit 1030.

An information processing apparatus 1001 transmits a print job to theimage processing system (1002 to 1027). The information processingapparatus 1001 is connected to the image processing system (1002 to1027) by a cable via a network such as Ethernet (registered trademark).

Data transmitted from the information processing apparatus 1001 to theimage processing system (1002 to 1027) is temporarily stored in areceiving buffer 1002.

A ROM 1003 stores a program for the image processing system, andincludes a command analysis unit 1004 for analyzing a PDL command and anintermediate data object creation unit 1005 for performing renderingprocessing, creating an intermediate data object from PDL data stored ina PDL data memory 1017 included in a RAM 1016, and storing theintermediate data object in an intermediate data object memory 1018included in the RAM 1016.

The ROM 1003 includes a rendering data creation unit 1006 for performingrendering processing, converting the intermediate data object stored inthe intermediate data object memory 1018 included in the RAM 1016 intorendering data (bitmap data), and storing the rendering data (bitmapdata) in a rendering data memory 1019 included in the RAM 1016.

The ROM 1003 includes a scanner image/FAX transmission and receptiondata processing unit 1007 for processing a scanner image and FAXtransmission/reception data, and an image processing unit 1009 forperforming color processing and screen processing upon image data to betransmitted to the engine unit 1028.

The ROM 1003 includes a network control unit 1012 for performing networkcontrol, a panel I/F control unit 1013 for performing panel interfacecontrol, and a device I/F control unit 1014 for controlling an interfacefor the scanner unit 1030.

A CPU 1015 is a CPU for the image processing system, and performsoverall control of the image processing system.

The RAM 1016 is used in the image processing system, and includes a PDLdata memory 1017 for storing the command analysis data analyzed by thecommand analysis unit 1004.

The RAM 1016 includes the intermediate data object memory 1018 forstoring the intermediate data object created from the PDL data stored inthe PDL data memory 1017 by the intermediate data object creation unit1005.

The RAM 1016 includes the rendering data memory 1019 for storing therendering data created from the intermediated data object stored in theintermediate data object memory 1018 by the rendering data creation unit1006.

The RAM 1016 includes a scanner image processing memory 1020 used forscanner image processing and a FAX transmission and reception processingmemory 1021 used for FAX transmission/reception processing, an imageprocessing memory 1022 used for image processing, and a panel displaymemory 1024 used for panel display processing.

An engine transfer unit 1025 for transferring bitmap information to theengine unit 1028 (to be described in detail below with reference to FIG.10), a panel I/F unit 1026 for transferring panel information to thepanel unit 1029, a device I/F unit 1027 for communicating with thescanner unit 1030, the engine unit 1028, the panel unit 1029, thescanner unit 1030, and an HDD 1031 are illustrated.

Engine Unit in Image Processing System

FIG. 10 illustrates an exemplary configuration of the engine unit 1028included in an image processing system.

As illustrated in FIG. 10, the engine unit 1028 is provided with ahousing 2001. The housing 2001 contains the following mechanisms. Thesemechanisms are controlled by the CPU 1015.

First, electrostatic latent images are formed on a photosensitive drumby laser beam scanning. The electrostatic latent images are visualized,and the visualized images are multiple-transferred onto an intermediatetransfer member 2010. There is provided an optical processing mechanismfor transferring a color image obtained by the multiple transfer to atransfer medium 2027 as a toner image.

There are provided a fixing processing mechanism for fixing the tonerimage transferred to the transfer medium 2027, a transfer medium feedingprocessing mechanism, and a transfer medium conveyance processingmechanism.

The optical processing mechanism includes a laser driver 2006 forperforming in a laser scanner portion 2020 ON or OFF control of laserlight emitted from a semiconductor laser (not illustrated) in accordancewith image data supplied from the controller (1002 to 1027). The laserlight emitted from the semiconductor laser is directed to a scanningdirection by a rotatable polygon mirror 2007.

The laser light directed to the main scanning direction is transferredto a photosensitive drum 2005 via a reflecting mirror 2008, and isemitted on the photosensitive drum 2005 in the main scanning direction.

The photosensitive drum 2005 is charged by a primary charging device2023, and is subjected to scanning exposure with laser light, so that alatent image is formed thereon. The latent image is visualized withtoner as a toner image.

The toner image is created in such a manner that toner is transferred(primary transfer) to the intermediate transfer member 2010 from thephotosensitive drum 2005 to which a voltage opposite in polarity to thetoner image is applied.

In forming a color image, development is performed by a yellowdeveloping device 2012Y, a magenta developing device 2012M, a cyandeveloping device 2012C, and a black developing device 2090 in thisorder while a developing rotary 2011 rotates every rotation of theintermediate transfer member 2010.

During four rotations of the intermediate transfer member 2010, yellow,magenta, cyan and black visible images are sequentially formed, so thata full-color visible image is formed.

In forming a monochrome image, development is performed only by theblack developing device 2090. A black visible image is formed during onerotation of the intermediate transfer member 2010, and the monochromevisible image is formed on the intermediate transfer member 2010(primary transfer).

The toner image formed on the intermediate transfer member 2010 istransferred onto the transfer medium 2027. The transfer medium 2027waiting at a registration shutter 2028 is conveyed and pressed againstthe intermediate transfer member 2010 by a transfer roller 2013. At thesame time, a bias opposite in polarity to toner is applied to thetransfer roller 2013. As a result, the toner image formed on theintermediate transfer member 2010 is transferred (secondary transfer)onto the transfer medium 2027 in synchronization with feeding of thetransfer medium 2027 in a sub-scanning direction which is performed bythe transfer medium feeding processing mechanism.

The photosensitive drum 2005, the yellow developing device 2012Y, themagenta developing device 2012M, the cyan developing device 2012C, andthe black developing device 2090 are detachable. The developing devicesexcept for the black developing device may be contained in thedeveloping rotary 2011.

The reflecting mirror 2008 is a semi-transmitting mirror, and a beamdetector 2009 for detecting laser light is disposed behind thereflecting mirror 2008. A laser light detection signal is supplied to aprinter controller 2003.

The controller (1002 to 1027) generates a horizontal synchronizationsignal for determining exposure timing in a main scanning direction onthe basis of the laser light detection signal supplied from the beamdetector 2009. The horizontal synchronization signal is output to thecontroller (1002 to 1027).

A cleaner 2022 removes toner remaining on the photosensitive drum 2005.A pre-exposure lamp 2021 optically discharges the photosensitive drum2005.

The transfer roller 2013 is movable in the horizontal direction in thedrawing, and has a driving portion. While toner images of four colorsare formed on the intermediate transfer member 2010, that is, theintermediate transfer member 2010 rotates a plurality of times, thetransfer roller 2013 stays down and is apart from the intermediatetransfer member 2010 as indicated by the solid line in the drawing so asnot to interrupt the formation of the toner images.

After the toner images of four colors have been formed on theintermediate transfer member 2010, a cam member (not illustrated)presses the transfer roller 2013 against an upper position indicated bythe dotted line in the drawing in synchronization with the transfer of acolor image on the transfer medium 2027.

That is, the transfer roller 2013 is pressed against the intermediatetransfer member 2010 via the transfer medium 2027 at a predeterminedpressure. At that time, the transfer roller 2013 receives a bias totransfer the toner images on the intermediate transfer member 2010 ontothe transfer medium 2027.

A transfer roller cleaner 2046 cleans the transfer roller 2013, if toneris applied from the intermediate transfer member 2010 to an area outsidethe transfer medium, and is then transferred to the transfer roller2013. Various sensors are disposed around the intermediate transfermember 2010.

There are provided an image formation start position detection sensor2044T for determining the print start position in forming an image, asheet feeding timing sensor 2044R for adjusting feeding timing of atransfer medium, and a density sensor 2044C for measuring the density ofa patch image in density control.

When density control is performed, the density sensor 2044C measures thedensity of each patch.

The fixing processing mechanism includes a fixing device 2014 for fixinga toner image transferred on the transfer medium 2027 by heat pressing.

The fixing device 2014 includes a fixing roller 2015 for applying heatto the transfer medium 2027, and a pressing roller 2016 for pressing thetransfer medium 2027 against the fixing roller 2015.

The fixing roller 2015 and the pressing roller 2016 are hollow rollers,and includes heaters 2017 and 2018, respectively. The fixing roller 2015and the pressing roller 2016 transfer the transfer medium 2027 when theyare driven to rotate.

A transfer medium determination sensor 2045 for automatically detectingthe type of a transfer medium and improving the fixability is disposed.By adjusting a time period for which a transfer medium is passed throughthe fixing device in accordance with the characteristic of the transfermedium, a time period for which the transfer medium is conveyed ischanged.

The transfer medium feeding processing mechanism includes a cassette2024 for holding the transfer medium 2027 and a manual insertion tray2025.

The transfer medium feeding processing mechanism is configured toselectively feed a transfer medium from the cassette 2024 or the manualinsertion tray 2025.

The cassette 2024 includes a size detection mechanism for electricallydetecting the size of a transfer medium by detecting the position of apartition plate (not illustrated).

Transfer media are conveyed to a sheet feeding roller 2038 one by onefrom a transfer medium at the top of the stack of transfer media held inthe cassette 2024 by rotating a cassette sheet feeding clutch 2026.

The cassette sheet feeding clutch 2026 includes a cam that isintermittently rotated by a driving portion (not illustrated) each timea sheet is fed. That is, a single transfer medium is fed each time thecam rotates.

The sheet feeding roller 2038 conveys the transfer medium until theleading end of the transfer medium moves to a position corresponding tothe registration shutter 2028.

The registration shutter 2028 stops or restarts the feeding of atransfer medium by applying or releasing pressure to the transfermedium. The operation of the registration shutter 2028 is controlled insynchronization with the sub-scanning of laser light.

The manual insertion tray 2025 is disposed at the housing 2001. If auser puts a transfer medium on the manual insertion tray 2025, thetransfer medium is fed to the registration shutter 2028 by a sheetfeeding roller 2009.

The transfer medium conveyance processing mechanism for conveying atransfer medium includes a conveyance roller 2039, flappers 2036 and2037, conveyance rollers 2040, 2041, and 2042, and a driving portion fordriving these conveyance rollers.

The conveyance roller 2039 conveys a transfer medium to the intermediatetransfer member 2010 when the pressure applied by the registrationshutter 2028 to the transfer medium is released.

The flappers 2036 and 2037 transfer a transfer medium from the fixingdevice 2014 to a sheet output tray FD disposed on the top of the housing2001.

The conveyance rollers 2040, 2041, and 2042 convey a transfer medium.The driving portion (not illustrated) drives the conveyance rollers2040, 2041, and 2042.

The flapper 2037 can change a sheet output tray, that is, switch betweenthe sheet output tray FD formed on the top of the housing 2001 and asheet output tray FU formed on the side of the housing 2001.

Duplex printing can be performed by exchanging the flapper 2036.

A reverse sheet feeding portion 2030 has engine conveyance rollers 2031,2032, and 2033 and a flapper 2034.

The housing 2001 is provided with a panel portion 2002 (the panel unit1029 illustrated in FIG. 2). An external memory unit 2043 is an externalmemory used for storage of print data.

General Image Processing

Next, a printing operation performed in the above-described imageprocessing system will be described.

After the information processing apparatus 1001 has performed printingin accordance with a user's instruction, control code and datatransmitted from the information processing apparatus 1001 via a networkcable are temporarily stored in the receiving buffer 1002.

The data is transmitted from the receiving buffer 1002 to the commandanalysis unit 1004, and is then analyzed in accordance with a programdescribed in the command analysis unit 1004. The analyzed data is storedin the PDL data memory 1017.

The data is processed in accordance with a program described in theintermediate data object creation unit 1005, so that an intermediatedata object is generated for each (image object) of graphic data,character data, and image data.

If the intermediate data objects are generated for all image objectsincluded in one page, these intermediate data objects are converted intopieces of rendering data in accordance with a program described in therendering data creation unit 1006. The converted pieces of bitmap dataare subjected to color conversion and screen processing in the imageprocessing unit 1009.

The pieces of bitmap data, which have been subjected to the screenprocessing, are transmitted to the engine unit 1028 via the enginetransfer unit 1025, and are then printed on a transfer medium. Theprinted transfer medium is output from a specified sheet output port.

Next, an image processing process according to the first embodiment willbe described with reference to FIG. 1. This process is performed by theCPU 1015 illustrated in FIG. 2.

Image data transmitted from an information processing apparatus via aprinter driver is input into a controller (1002 to 1027) as PDL data(step S101).

The controller (1002 to 1027) determines whether a region to beconverted is detected from the input PDL data (step S102). The region tobe converted will be described in detail below.

If the region to be converted is not detected from the PDL data (NO insteps S102), the image processing unit 1009 performs image processing B(step S104).

In the image processing B, image data is converted into pieces of colordata of cyan, magenta, yellow, and black, and these pieces of color dataare quantized and are then subjected to screen processing. For example,a portion painted red is converted into pieces of color data of magentaand yellow, and these pieces of color data are subjected to screenprocessing (see e.g., FIG. 4). In FIG. 4, a left part illustrates anoriginal image, and a right part illustrates an image that has beensubjected to the screen processing.

If the region to be converted is detected from the image data (YES instep S102), image processing A is performed (step S103). The imageprocessing A is image processing employing the “watercolor effect”.

The image processing unit 1009 acquires color information of an innerportion inside the region to be converted in which image formation is tobe performed, and renders a border of the inner portion inside theregion to be converted using a color having a density higher than thatof a color indicated by the color information (see e.g., FIG. 5).

In FIG. 5, a left part illustrates a detected image, and a right partillustrates an image that has been subjected to the image processing A.The image processing A will be described in detail below.

The image that has been subjected to image processing is transmittedfrom the engine transfer unit 1025 to the engine unit, and is thenrecorded on a sheet (step S105).

The image that has been subjected to image processing can be transmittedand output without being printed.

Detection Method of Region to Be Converted

A detection method of the region to be converted will be described withreference to FIG. 6. The process illustrated in FIG. 6 is performed bythe CPU 1015 illustrated in FIG. 2.

First, the image processing unit determines whether there is an imagesandwiched between at least a pair of lines (S601).

The sandwiched image is not necessarily in enclosed space. For example,the sandwiched image may be in a space between a pair of lines asillustrated in FIG. 3C, or may not be a rectangle as illustrated in FIG.3B.

It is determined whether the density of the sandwiched image is equal toor lower than a predetermined density (step S602). It is assumed thatthe predetermined density is a density of 15% that is the same as thedensity of the most highlighted portion.

Furthermore, it is determined whether the pixel density of thesandwiched image is uniform (step S603).

Only if Yes in steps S601, S602, and S603, it is determined that thereis a region to be converted (step S604). If No in any one of steps S601,S602, and S603, it is determined that there is no region to be converted(step S605).

For example, the region to be converted may be an image illustrated inFIG. 3A, 3B, or 3C which is sandwiched between lines and in which animage of uniform density equal to or lower than a predetermined densityis to be formed.

It may be difficult to reproduce a low-density area in anelectrophotographic image processing apparatus using a method in therelated art. However, by performing the image processing A to bedescribed in detail below upon the region to be converted so as togenerate a pseudo low-density area using a human visual characteristic,it is possible to stably reproduce such a low-density area.

The stable reproduction of a low-density area means that a recordingmaterial such as toner can be supplied in accordance with a specifieddensity value regardless of an environmental change after installationof an apparatus, the temperature or humidity at an installation locationof an apparatus, or the endurance of a used sheet or apparatus.

Image Processing A

The image processing A will be described with reference to FIG. 7. Theprocess illustrated in FIG. 7 is performed by the CPU 1015.

In the image processing A, information about a paint color of the regionto be converted is obtained from PDL data (step S701). On the basis ofthe obtained paint color information, an inner portion of the region tobe converted is bordered by a line. As the color of the border line, acolor having the same hue as that of an original color used for an imageformed in the region to be converted and having a luminance level lowerthan that of the original color (a density higher than that of theoriginal color) is selected. The color having the same hue as that ofthe original color represents a color illusively perceived as beingequivalent to the original color or a color used to give a viewer theillusion that the color is similar to the original color when the mosthighlighted portion is reproduced using the “watercolor effect”. Thedensity of the border line is higher than that of the paint color (stepS702). The density of the border line is calculated, for example, usingthe following equation.

DL=Dp*n+α

In this equation, DL denotes the density of a line, Dp denotes thedensity of a paint color of the region to be converted, n denotes acorrection coefficient, and α denotes a correction value.

The width of a line may be optionally determined. However, since a lineof an excessively large width is noticeable, it is desirable that a linehaving a width of five points or less be used. The width of a renderedline does not significantly affect the effect of painting.

An inner portion inside the region to be converted is bordered by a linehaving the determined density and the determined width (step S703). Atthat time, the output setting (color information) of a recordingmaterial, which is set in the PDL data so as to form an image in theregion to be converted, may be reset. That is, the PDL data may beconverted so as to prevent recording of the most highlighted portionwhich has been originally set.

In order to obtain a greater effect of the image processing A, it isdesirable that there be no gradation between the rendered line and theedge of the region to be converted. Even if the background of the regionto be converted (the area outside the edge of the region do beconverted) is colored, a similar effect can be obtained.

According to the first embodiment, the reproducibility of the mosthighlighted portion can be improved in outputting a printed image.Stable reproduction of the most highlighted portion of an original maytherefore be provided. The first embodiment is available for a FAXtransmission image.

The second embodiment will be described with reference to FIG. 8. Theprocess illustrated in FIG. 8 is performed by the CPU 1015 illustratedin FIG. 2. If a user makes a copy, image data is transmitted to thecontroller (1002 to 1027) via the scanner unit 1030, and is then outputto the image processing unit 1009 as a scan image (step S801).

The image processing unit 1009 determines whether a region to beconverted is detected from the scan image (step S802). If the region tobe converted is not detected from the scan image (NO in step S802), theimage processing B is performed (step S804).

In the image processing B, image data is converted into pieces of colordata of cyan, magenta, yellow, and black, and these pieces of color dataare quantized and are then subjected to screen processing. For example,a portion painted red is converted into pieces of color data of magentaand yellow, and these pieces of color data are subjected to screenprocessing (see e.g., FIG. 4). In FIG. 4, a left part illustrates anoriginal image, and a right part illustrates an image that has beensubjected to the screen processing.

If the region to be converted is detected from the image data (YES instep S802), the image processing A is performed (step S803). Asdescribed previously, the image processing A is image processingemploying the “watercolor effect”, and may be performed as illustratedin the example shown in FIG. 7.

In FIG. 5, a left part illustrates a detected image, and a right partillustrates an image that has been subjected to the image processing A.The image processing A has been described in detail with reference toFIG. 7.

The image that has been subjected to image processing is transmittedfrom the engine transfer unit 1025 to the engine unit, and is thenrecorded on a sheet (step S805).

According to the second embodiment, the reproducibility of the mosthighlighted portion can be improved in outputting a printed image.

An apparatus for automatically changing predetermined density of animage detected as the region to be converted using density change dataof an electrophotographic engine will be described as the thirdembodiment on the basis of the apparatus described in the first orsecond embodiment.

An engine always monitors the change in the density of toner applied toa sheet using the density sensor 2044C.

Accordingly, it may be determined that the engine cannot output an imagehaving a density indicated by an input signal due to the endurance of anapparatus or the installation environment of the apparatus.

For example, an original image having a pixel density of 18% on a sheetand an original image having a pixel density of 10% on the sheet, whichare input into an apparatus as signals, may be printed as imagesobtained by applying a recording material such as toner at approximatelythe same pixel density.

At that time, the engine transmits a determination result to the imageprocessing unit 1009 via the engine transfer unit 1025 as engineinformation.

On the basis of the engine information, the image processing unit 1009increases the predetermined density used for detection of the region tobe converted.

That is, if the predetermined density used for the detection of theregion to be converted is increased, an image having a pixel density of15% or more, which is not usually detected as the most highlightedportion, may be determined to include the region to be converted.

Accordingly, even if the density of an image is higher than thepredetermined density that is the same as that of the most highlightedportion, the image includes a portion to be subjected to the imageprocessing A using the “watercolor effect” as illustrated in the exampleshown in FIG. 7.

Thus, in the third embodiment, when the region to be converted isdetected, a predetermined pixel density used for the detection of themost highlighted portion is changed on the basis of the engineinformation.

As a result, in outputting a copied/printed image, the most highlightedportion can be stably detected and reproduced without being affected bythe density change of an engine.

An apparatus for allowing a user to optionally set a predetermineddensity used for the detection of the region to be converted will bedescribed as the fourth embodiment on the basis of the apparatusdescribed in the first or second embodiment.

It is assumed that a user can input a predetermined density value at anyone of a driver, a body panel, and a remote panel such as a Web panel.

FIG. 12 illustrates an example of a setting screen of a driver UI usedto detect the region to be converted.

Density 1201 allows a user to set a predetermined density used fordetection of a certain region.

If a lever is moved to the minimum density, the density range of aregion to be detected is narrowed. If the lever is moved to the maximumdensity, the density range of the region to be detected is extended anda high density can be detected.

That is, if the density range of the region to be detected is narrowed,the image processing A using the “watercolor effect” is performed upononly a region having a low pixel density.

On the other hand, if the density range of the region to be detected isextended, the image processing A using the “watercolor effect” can alsobe performed upon a region having a high pixel density.

According to the fourth embodiment, a user can optionally control thereproducibility of the most highlighted portion in outputting acopied/printed image, and image processing according to the presentinvention can be applied to a user's desired color region.

An apparatus capable of determining an image to be detected as theregion to be converted using the area of the image will be described asthe fifth embodiment on the basis of the apparatus described in thefirst or second embodiment. That is, only an image having apredetermined area is detected as the region to be converted, and a usercan optionally set the predetermined area.

FIG. 9 illustrates an example of a process of detecting the region to beconverted. The process may be performed by the CPU 1015 illustrated inFIG. 2.

The process illustrated in FIG. 9 is obtained by adding thedetermination of whether the area of a sandwiched image is equal to orsmaller than a predetermined area (step S902) to the process illustratedin FIG. 6 described in the first embodiment. The predetermined area maybe set in advance by an administrator of an apparatus.

It is known that the area of an image achieving the “watercolor effect”is proportional to the distance between each eye and a sheet.Accordingly, if an image is output on a frequently used A4 sheet, it isdesirable that the image processing A be performed upon a region havingan area of 25 cm² (5*5 cm) or less so as to obtain a grater effect ofthe image processing A.

Accordingly, in an apparatus in which an A4 sheet is frequently used asa print medium, a predetermined area of 25 cm² is set and the imageprocessing A using the “watercolor effect” is performed upon a regionhaving an area of 25 cm² or less.

According to the fifth embodiment, if the most highlighted portion isreproduced by performing image processing using the “watercolor effect”upon the most highlighted portion in outputting a copied/printed image,it is possible to perform the image processing using the “watercoloreffect” upon only a region having an area achieving a greater effect ofthe image processing.

An apparatus for allowing a user to optionally set a predetermined areaused to detect the region to be converted will be described as the sixthembodiment on the basis of the apparatus described in the fifthembodiment.

It is known that the area of an image achieving the “watercolor effect”is proportional to the distance between each eye and a sheet.Accordingly, if an image is output on a frequently used A4 sheet, it isdesirable that the image processing A be performed upon a region havingan area of 25 cm² (5*5 cm) or less so as to obtain a greater effect ofthe image processing A.

If an image is output on an A4 sheet as a poster image or the like, thedistance between each eye and the A4 sheet is relatively long.Accordingly, even if the image processing A is performed upon a regionhaving an area of 100 cm² (10*10 cm) or more, the effect of the imageprocessing A can be obtained. A predetermined area of a region to besubjected to the image processing A is therefore determined by a user atthe time of printing.

It is assumed that a user can input a predetermined area at any one of adriver, a body panel, and a remote panel such as a Web panel.

FIG. 12 illustrates an example of a setting screen of a driver UI usedto detect the region to be converted. Area 1202 allows a user tooptionally set a predetermined area used for detection of the region tobe converted in consideration of the size of a print sheet each timeprinting is performed.

If a lever is moved to the minimum area, the area of the region to beconverted is reduced. If the lever is moved to the maximum area, thearea of the region to be converted is increased. For example, ifprinting of a poster is performed, the lever is moved to the maximumarea since the effect of the image processing A using the “watercoloreffect” can be obtained even in a large region.

Thus, if a user can optionally set a predetermined area of the region tobe converted, it is possible to effectively perform the image processingA upon a pattern region having a relatively large area.

According to the sixth embodiment, a user can optionally control apredetermined area of a region where the most highlighted portion is tobe reproduced at the time of outputting a copied/printed image, andimage processing according to the present invention can be applied toonly a rectangle having a desired area in consideration of the size ofan output image.

An apparatus for detecting the region to be converted and allowing auser to determine whether the image processing A should be performedupon the detected region to be converted will be described as theseventh embodiment.

In the image processing A, the original setting of a recording materialused for image formation on an inner portion of an image correspondingto PDL data is canceled so as to generate the border of the innerportion. Accordingly, the image processing A is performed with consentof a user. That is, a processing determination unit is disposed forreceiving a processing determination signal input by a user from any oneof a driver, a body panel, and a remote panel such as a Web panel.

FIG. 11 illustrates an example of an image processing setting screen ofa driver UI. Halftone 1101 allows a user to select one of screensettings. If the image processing A is desired, highlight specialprocessing 1102 is selected.

According to the seventh embodiment, a user can determine whether theimage processing A according to the present invention should be used.

An apparatus capable of previewing an image that has been subjected tothe image processing A will be described as the eighth embodiment on thebasis of the apparatuses described in the first to seventh embodiments.Previewing is performed by the panel I/F unit 1026 and the panel unit1029 which are illustrated in FIG. 2. A preview screen may be remotelydisplayed on an information processing apparatus via the Web.

FIG. 13 is a diagram illustrating an example of a preview screen. Adisplayed image 1302 that has been subjected to the image processing Ais bordered by a line. An image 1301 that has been subjected to theimage processing B is displayed.

If a user presses a print button 1303 after checking the preview screen,printing is started.

According to the eighth embodiment, a user can check a result of imageprocessing according to the present invention using a preview screen.

An apparatus for allowing a user to determine whether the imageprocessing A should be performed while checking a preview screen, whichis like an apparatus according to the eighth embodiment, will bedescribed as the ninth embodiment. A user can determine whether an imagethat has been subjected to the image processing A should be employed bychecking the image on a preview screen.

FIG. 14 illustrates an example of a preview screen. A displayed image1402 that has been subjected to the image processing A is bordered by aline. An image 1401 that has been subjected to the image processing B isdisplayed.

If a user determines that the image processing A should be performedafter checking the image displayed on the preview screen, the userpresses an image processing A use button 1403. Subsequently, printing ofthe image that has been subjected to the image processing A is started.

According to the ninth embodiment, a user can determine whether a resultof image processing according to the present invention should beemployed by checking the result of the image processing on a previewscreen.

A processing method of storing a program and/or computer-executableinstructions that achieves functions of the above-described embodimentsin a computer-readable storage medium, reading the program and/orcomputer-executable instructions from the storage medium as code, andexecuting the read code in a computer falls within a scope of theabove-described embodiments. Not only the storage medium storing theabove-described program but also the program and/or computer-executableinstructions itself are included as aspects of the above-describedembodiments.

Such storage media include a floppy disk, a hard disk, an optical disc,a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memorycard, and a ROM.

Not only the method of causing a single program and/or computerexecutable instructions stored in the above-described storage medium toperform processing but also a method of causing the program and/orcomputer-executable instructions to operate on an OS in conjunction withanother piece of software or a function of an extension board so as toperform operations of the above-described embodiments fall within thescope of the above-described embodiments.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all modifications and equivalent structures and functions.

This application claims the benefit of Japanese Application No.2008-104647 filed Apr.14, 2008, which is hereby incorporated byreference herein in its entirety.

1. An image processing apparatus comprising: a region detection unitconfigured to detect from an image a region which is sandwiched betweena pair of opposite lines and in which image formation is performed at adensity lower than a predetermined density; a rendering unit configuredto render a border of an inner portion inside the region sandwichedbetween the pair of opposite lines with a line having a density higherthan the predetermined density; and an outputting unit configured tooutput an image in which the inner portion inside the region sandwichedbetween the pair of opposite lines is bordered by the border rendered bythe rendering unit.
 2. The image processing apparatus according to claim1, wherein the predetermined density is a density of 15%.
 3. The imageprocessing apparatus according to claim 1, wherein the border of theinner portion is rendered with the line having the same hue as that of arecording material used for image formation in the detected region andhaving a density higher than a density at which image formation isperformed in the detected region.
 4. The image processing apparatusaccording to claim 1, further comprising a density sensor configured todetect a density change of a recording material used for image formationon a sheet, and wherein the predetermined density is changed inaccordance with the density change of a recording material detected bythe density sensor.
 5. The image processing apparatus according to claim1, wherein predetermined density setting information is generated and isthen displayed so as to allow a user to set the predetermined densityusing the predetermined density setting information.
 6. The imageprocessing apparatus according to claim 1, wherein a predetermined areaused to evaluate the area of the region sandwiched between the pair ofopposite lines is determined, and wherein, only in a case where theregion sandwiched between the pair of opposite lines has an area smallerthan the predetermined area, image processing is performed upon theregion sandwiched between the pair of opposite lines.
 7. The imageprocessing apparatus according to claim 6, wherein the predeterminedarea used to evaluate the area of the region sandwiched between the pairof opposite lines is an area of 25 cm².
 8. The image processingapparatus according to claim 6, wherein predetermined area settinginformation is generated and is then displayed so as to allow a user toset the predetermined area used to evaluate the area of the regionsandwiched between the pair of opposite lines using the predeterminedarea setting information.
 9. The image processing apparatus according toclaim 6, wherein the predetermined area used to evaluate the area of theregion sandwiched between the pair of opposite lines is determined inaccordance with the area of a print sheet.
 10. The image processingapparatus according to claim 1, wherein an image that has been subjectedto rendering by the rendering unit can be checked on a preview screen.11. The image processing apparatus according to claim 10, furthercomprising a receiving unit configured to, after the image that has beensubjected to rendering by the rendering unit has been displayed on thepreview screen, receive a result of determination of whether the imageshould be printed.
 12. An image processing method comprising: detectingfrom an image a region which is sandwiched between a pair of oppositelines and in which image formation is performed at a density lower thana predetermined density; rendering a border of an inner portion insidethe region sandwiched between the pair of opposite lines with a linehaving a density higher than the predetermined density; and outputtingan image in which the inner portion inside the region sandwiched betweenthe pair of opposite lines is bordered.
 13. The image processing methodaccording to claim 12, wherein the predetermined density is a density of15%.
 14. The image processing method according to claim 12, wherein theborder of the inner portion is rendered with the line having the samehue as that of a recording material used for image formation in thedetected region and having a density higher than a density at whichimage formation is performed in the detected region.
 15. The imageprocessing method according to claim 12, further comprising detecting adensity change of a recording material used for image formation on asheet, and wherein the predetermined density is changed in accordancewith the detected density change of a recording material.
 16. The imageprocessing method according to claim 12, wherein predetermined densitysetting information is generated and is then displayed so as to allow auser to set the predetermined density using the predetermined densitysetting information.
 17. The image processing method according to claim12, wherein a predetermined area used to evaluate the area of the regionsandwiched between the pair of opposite lines is determined, andwherein, only in a case where the region sandwiched between the pair ofopposite lines has an area smaller than the predetermined area, imageprocessing is performed upon the region sandwiched between the pair ofopposite lines.
 18. The image processing method according to claim 17,wherein the predetermined area used to evaluate the area of the regionsandwiched between the pair of opposite lines is an area of 25 cm². 19.The image processing method according to claim 17, wherein predeterminedarea setting information is generated and is then displayed so as toallow a user to set the predetermined area used to evaluate the area ofthe region sandwiched between the pair of opposite lines using thepredetermined area setting information.
 20. The image processing methodaccording to claim 17, wherein the predetermined area used to evaluatethe area of the region sandwiched between the pair of opposite lines isdetermined in accordance with the area of a print sheet.
 21. The imageprocessing method according to claim 12, wherein an image that has beensubjected to rendering can be checked on a preview screen.
 22. The imageprocessing method according to claim 21, further comprising receiving,after the image that has been subjected to rendering has been displayedon the preview screen, a result of determination of whether the imageshould be printed.
 23. A computer-readable storage medium havingcomputer-executable instructions stored therein for causing an imageprocessing apparatus to execute an image processing method, thecomputer-readable storage medium comprising: computer-executableinstructions for detecting from an image a region which is sandwichedbetween a pair of opposite lines and in which image formation isperformed at a density lower than a predetermined density;computer-executable instructions for rendering a border of an innerportion inside the region sandwiched between the pair of opposite lineswith a line having a density higher than the predetermined density; andcomputer-executable instructions for outputting an image in which theinner portion inside the region sandwiched between the pair of oppositelines is bordered.